Parallel recursive prediction error algorithm for training layered neural networks

Parallel recursive prediction error algorithm for training layered neural networks

International Journal of Control Publication details, including instructions for authors and subscription information: http://www.informaworld.com/smpp/title~content=t713393989 Parallel recursive prediction error algorithm for training layered neural networks S. Chen a; C. F. N. Cowan a; S. A. Billings b; P. M. Grant a a Department of Electrical Engineering, University of Edinburgh, Edinburgh, ...

Training Recurrent Neural Networks by Using Parallel Recursive Prediction Error Algorithm

As an alternative local and higher order algorithm, the parallel recursive prediction error algorithm (PRPE) is used to train the recurrent neural networks (RNNs). This algorithm uses a modiied form of the well-known recursive prediction error algorithm (RPE) such that the computation can be distributed into each node in the network. Therefore, the algorithm has a better trade-oo between comput...

Parallel Training of Large Scale Neural Networks: Performance Analysis & Prediction

Large scale neural networks, and Convolutional Neural Networks (CNNs) in particular, are a very promising solution for complicated vision applications such as face detection and object classification. CNNs can perform very robust classification under varying circumstances such as lighting conditions, location invariance and small distortions. Their accuracy on these vision applications is compa...

An LMS Algorithm for Training Single Layer Globally Recursive Neural Networks

Unlike feedforward neural networks (FFNN) which can act as universal function approximaters, recursive neural networks have the potential to act as both universal function approximaters and universal system approximaters. In this paper, a globally recursive neural network least mean square (GRNNLMS) gradient descent or a real time recursive backpropagation (RTRBP) algorithm is developed for a s...

Conjugate gradient algorithm for training neural networks